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ABSTRACT 

In  this  paper,  we  investigate  a  recursive  multiple  model  tracking 
approach  similar  to  the  Generalized  Pseudo-Bayesian  1  (GPB1)  [1] 
approach.  However,  here  we  consider  a  continuum  of  models  rather  than 
the  discrete  set  that  is  usually  implemented  in  the  GPB1  method.  By  doing 
so  better  models  are  available  to  improve  tracker  performance  and  solve 
the  bias  problem  inherent  in  most  multiple  model  approaches. 

1  Introduction 

In  tracking  systems,  we  don’t  have  precise  knowledge  of  the  system  model. 
For  this  reason,  crude  models  such  as  constant  velocity,  constant  acceleration,  and 
constant  turn  rate  models  have  been  developed.  However,  to  capture  scenarios  that  are 
not  represented  by  the  given  model,  much  uncertainty  is  added  to  the  model  in  the  form 
of  large  process  noise.  To  reduce  this  uncertainty,  researchers  have  implemented 
combinations  of  many  different  models  in  multiple  model  approaches.  However,  our 
research  has  shown  that  most  designs  still  require  large  uncertainties  to  capture  the 
wide  possibilities  of  target  maneuvers.  Consequently,  tracking  systems  tend  to  ride  the 
measurements  (that  is,  the  estimate  error  is  about  the  same  as  the  measurements)  as 
little  weight  is  placed  on  the  model's  prediction  and  much  weight  is  given  to  the 
measurements. 


However,  by  choosing  a  set  of  models  that  lie  upon  some  continuum  of 
models  (as  proposed  in  this  paper)  the  uncertainty  in  each  model  may  be  reduced. 
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allowing  the  filter  to  appropriately  give  more  weight  to  the  filters  estimate  and  reducing 
the  overall  estimate  error.  Further,  by  having  the  models  densely  spaced  the  system 
does  not  have  to  interpolate  between  sparsely  spaced  models  thus  improving  the 
performance  when  operating  between  system  models.  This  is  one  problem  that  this 
paper  addresses. 

Another  problem  we  have  found  with  multiple  model  approaches  is  due  to 
“non-symmetry”  of  the  models.  For  example,  suppose  we  have  3  constant  velocity 
models  with  acceleration  biases  of  -1g,  Og,  and  -i-1g.  Further  suppose  that  the  current 
maneuver  is  .6g.  In  this  situation  models  Og  and  1g  compete  and  the  likelihood  of  the  — 
-1g  models  are  not  necessarily  zero.  Consequently,  these  models  will  bias  the  result 
towards  the  result  obtained  for  the  -1g  and  Og  accelerations.  Flowever,  by 
implementing  a  continuum  of  models  we  maintain  symmetry  about  the  true  maneuver. 
A  similar  phenomenon  was  first  observed  in  [2]  where  a  large  number  of  models 
compete  thus  reducing  performance  as  an  increased  number  of  models  are  added. 

Further  too  few  model  leave  modeling  gaps  and  higher  uncertainty.  The  problem 
studied  here  is  to  reduce  the  biases  of  the  IMM  constant  when  compared  to  the 
Stochastic  Estimation  using  a  Continuum  of  Models 

2  Algorithm  development 

The  continuum-model  algorithm  derivation  is  similar  to  the  derivation  of  the 
GPB1  algorithm.  The  difference  is  that  the  GPB1  processes  each  of  its  (finite  number 
of)  models  separately,  whereas  in  the  continuum-model  algorithm  the  infinite  number  of 
Kalman  filter  models  are  evaluated  together,  taking  advantage  of  an  assumed  structure 
that  relates  all  the  models  in  the  continuum. 

In  the  development  that  follows,  we  apply  the  same  procedures  used  in 
developing  the  GPB1  algorithm  except  a  continuum  of  models  is  employed.  The  steps 
follow  the  development  presented  in  [1]. 


2.1  Constant  position  modei  with  veiocity  bias 


In  this  continuum-model  algorithm  derivation  we  assume  knowledge  of  the 
truth  model  with  the  exception  of  the  object's  time-varying  velocity.  The  system  truth 


model  is  assumed  to  be  a  known  constant  position  model  with  and  unknown  velocity 
bias  given  as 

x(k)  =  x(k-1 )  +T  Vk+  (o(k-1 )  CO  ~  N(0,Q)  ,  T  g  IR  (1 ) 

z(k)  =  H  x(k)  +  v(k-1)  V  ~  N(0,R)  ,  H  G  IR  (2) 

where  co  and  v  are  zero-mean,  Gaussian,  white  noise  and  T  is  the  time  step  between 
measurements  updates. 

By  implementing  a  continuum  of  (constant-position  with  velocity  bias)  Kalman 
filter  models  whose  velocities  span  across  all  possible  target  velocities  v^g  [00,00],  we 

know  that  one  of  the  unaccountably  infinite  numbers  of  models  will  match  the  truth 
model  exactly. 

We  will  demonstrate  that  when  propagating  the  current  state  estimate  (and 
associated  covariance)  through  the  continuum  of  Kalman  filter  models,  the  state 
estimate  for  a  given  time-step  will  remain  in  the  form 

x(k-1  ,vk.i  |k-1 )  =  a(k-1  |k-1 )  vk-i  +  b(k-1  |k-1 )  (3) 

where  a(k-1|k-1),  b(k-1|k-1)  g  IR  are  the  slope  and  intercept  respectively  of  the  affine 
function  of  Vk-1.  Because  a(k-1|k-1)  and  b(k-1|k-1)  are  independent  of  Vk-1,  the  form 

given  in  (3)  allows  us  to  analytically  describe  x(k-1  ,Vk-i  |k-1)  through  the  computation  of 
a(k-1  |k-1 )  and  b(k-1  |k-1 )  without  requiring  knowledge  of  Vk-1 .  This  compact  description 
allows  us  to  perform  state  estimation  (for  the  next  time-step)  through  each  of  the  infinite 
number  of  models  in  the  continuum  simultaneously,  simply  by  computing  a(k|k)and 
b(k|k).  Similarities  can  readily  be  seen  between  the  form  given  in  (3)  and  the  system 
model  given  in  (1). 


2.2  Propagation  of  State  Estimate 

Using  the  standard  Kalman  filter  notation  and  derivation,  we  recall  that  the 
propagation  of  the  state  estimate  from  time  k-1  to  time  k  applied  to  the  system  model 
(1)  and  (2)  is 


x(k,Vk|k-1)  =  x(k-1,Vk-i  |k-1)  +  Tvk  (4) 

where  x(k-1  ,vk-i  |k-1 )  is  available  from  the  previous  time-steps  computation.  By  letting 

a(k|k-1)=T,  (5) 

b(k|k-1)  =  x(k-1,vk-i|k-1)  (6) 

we  rewrite  (4)  as 

x(k,vk|k-1)=  a(k|k-1)vk  +  b(k|k-1)  (7) 


where  the  velocity  assumed  to  be  in  affect  on  the  previous  time-step  has  been 
incorporated  into  b(k|k-1).  Therefore  after  propagation,  the  state  estimate  is  still  an 
affine  function  of  the  current  velocity  bias,  Vk- 

2.3  Update  of  state  estimate 

Recall  that  a  measurement  update  of  the  state  estimate  at  time  k  applied  to  the 
system  model  is 

x(k,vk|k)  =  x(k,vk|k-1 )  +  W(k)[z(k)-H  x(k,vk|k-1 )]  (8) 

and  substituting  twice  using  (7)  results  in 
x(k,vk|k)=  a(k  |  k-1)  [1  -  W(k)H]  Vk 

+  b(k  I  k-1 )  +  W(k)  [z(k)  -  H  b(k  |  k-1 )]  (9) 

where  W(k)  is  the  Kalman  gain.  Therefore,  after  measurement  update  of  the  state 
estimate,  it  is  still  an  affine  function  of  the  velocity  bias  with  slope  and  intercept 

a(k|  k)  =  a(k|  k-1)[1 -W(k)H]  (10) 

b(k  I  k)  =  b(k  I  k-1 )  +  W(k)[z(k)  -  Hb(k  |  k-1 )]  (11) 

respectively,  yielding  the  same  form  assume  in  (3).  This  tells  us  by  induction  that  if  the 
initial  state  estimate  is  an  affine  function  of  the  velocity  bias  then  it  will  always  remain  so 
after  propagation  and  update  through  the  continuum  of  filters.  Now  we  show  how  the 
error  covariance  estimate  also  retains  this  affine  structure  through  the  propagation  and 
update  steps. 


2.4  Propagation  and  update  of  error  covariance  estimate 


Propagation  and  update  of  the  covariance  P(k-1|k-1)  g  fR  is  simpler  than 
that  just  performed  for  the  state  estimate  because  not  only  is  the  covariance 
independent  of  the  current  velocity  (as  was  a(k-1|k-1)  and  b(k-1|k-1))  it  is  independent 
of  velocity  at  any  time. 

Recall  that  the  propagation  of  the  state  error  covariance  estimate  to  time  k 
applied  to  the  system  is  given  by  the  following: 

P(k|k-1)  =  P(k-1  |k-1)  +  Q  (12) 

and  the  measurement  update  of  the  state  error  covariance  at  time  k  is  given  by 

P(k  I  k)  =  P(k  I  k-1 )  -  W(k)2  S(k)  (1 3) 

where  the  innovation  covariance  at  update  time  is 
S(k)  =  h2  P(k  I  k-1)  +  R 
and  the  Kalman  Gain  is 

W(k)  =  P(k  I  k-1)  H  S(k)-1 

P(k|k-1)H 
~  h2  P(k|k-1)  +  R  ■ 


(14) 

(15) 

(16) 


After  update,  the  state  error  covariance  is  given  by 


P(k  I  k)  =  P(k  I  k-1)  - 


(P(k  I  k-1)  H)2 
h2  P(k  I  k-1)  +  R 


(17) 


which  is  clearly  independent  of  velocity. 

This  derivation  of  the  propagation  and  update  of  the  error  covariance  estimate  tells  us 
by  induction  that  if  the  initial  error  covariance  on  a  continuum  of  filters  is  independent  of 
velocity  then  it  will  remain  so.  We  follow  along  the  same  procedure  as  GPB1  as  this 
architecture  does  destroyed  constant  nature  of  the  state  error  covariance  at  some  time 


k.  Hence  by  induction  if  covariance  is  constant  (independent  of  the  velocity)  then  it  will 
remain  so. 


2.6  Match  filtering 

The  likelihood  function  to  the  continuum  of  velocity  biases  as  a  function  of 
the  measurement  at  time  k  is  given  by 


A(k,  vk)  =  p[z(k)  I  vk,  Z(k-1)]) 

=  p[z(k)  I  Vk,  x(k-1  ,vk.i  |k-1),  P(k-1|k-1)]) 


(18) 

(19) 


where  Z(k)  =  {z(k),  z(0)}  is  the  set  of  all  measurement  through  time  k.  The  best 

estimated  mean  of  z(k)  using  x(k-1  ,Vk-i  |k-1),  P(k-1|k-1)),  and  the  model  used  to 


propagate  them,  is  Hx(k,Vk  |  k-1))  giving  the  Gaussian  probability  density  function. 


A(k,  Vk)  = 


1 


V27iS(k) 

1 


exp 


\l2%S{W) 


exp 


[z(k)-Hx(k,Vk|k-1)]2 
2S(k) 

[z(k)-Ha(k|k-1)vk-  Hb(k|k-1)]2' 

2S(kj 


(20) 


(21) 


2.7  Probability  update  for  v  k 

The  following  is  a  recursion  that  updates  the  probability  density  function  for  a 
target-exhibiting  behavior  from  a  model  in  the  continuum  with  velocity  vk 


l^(vk)  =  P[vk  I  Z(k)]  (22) 

=  p[vk|z(k),Z(k-1)]  (23) 

=  jp[z(k)|Vk,Z(k-1)lp[Vk|Z(k-1)]  (24) 

1 

=  c  A(k,  Vk)  /  p[vk  I  vk-1 ,  Z(k-1 )]  P[vk-1 1  Z(k-1 )]  dvk-i  (25) 

-oo 

where  the  last  equation  makes  use  of  the  total  probability  theorem  and  c  is  the 
normalization  constant.  Let  the  probability  |i(vk-i)  =  p[vk-il  Z(k-1)]  be  given  by  the 
following  Gaussian  probability  density  function 


^^(Vk-1) 


1 

[vk-i-mp(k-1)]2“ 

^27iOp(k-1) 

(26) 


where  m^(k-1)  and  ajj^(k-l)  are  the  mean  and  variance  respectively  of  the  probably 
density  function  for  vk.-|.  Also,  let  the  transition  probability  p[vk  |  vk.-],  Z(k-1)]  to  be  a 
Gaussian  with  a  probability  density  given  by 


P[vkl  vk-l,Z(k-1)]  = 


exp 


[vk- Vk-1]2 


2o: 


P  J 


(27) 


where  Op  is  the  covariance  associated  with  model  transitions.  Substituting  Equations 
(26)  and  (27)  into  (25)  yields 


oo 


-| 

r 

[Vk- Vk-1]2 

[vk-1-mu(k-1)]2 

p(vk)  =^A(k,  Vk) 

exp 

exp 

_ ! _ L__ _ 

2 

I 

J  Q. 
D 

C\J 

_ I 

L  ^yk-D  J 

dvk-1 


(28) 


=  ^A(k,  Vk) 


r 

[Vk-Vk-1]^  [vk-1-mM(k-1)]2 

exp 

2  '  2 

J 

L  2yk-i)  J 

dvk-1 


(29) 


ci 


A(k,  Vk) 


exp 


[Vk~^^k-1  Vk  + Vl]  [Vr^^k-1  m^(k-1)  +  m^(k-1)] 

2ap  2<,^(k-1) 


dvk-1 


(30) 


C1 


A(k,  Vk)  exp 


OO 


r  2 

/* 

<\i 

> 

+ 

> 

> 

C\J 

1 _ 

[Vk-1  -2vk-i  m^(k-1)] 

A 

J 

exp 

2a2(k-1) 

dVk-1 


-OO 


(31) 


:  — A(k,  Vk)  exd 


- 1 

< 

Lx-  ro 

3 

_ i 

Op  +  a^^(k-l)' 

2 

_2ap  2ap(k-1)_ 

J 

exp 

2a^a"p(k-1)^ 

Vl  + 

V 

2m^(k-1)ap  +  2Vk  a^{k-1)^ 
2  2 


2apa^{k-1) 


Vk-I 


where  c-\  is  the  normalizing  constant.  From  [3]  we  find 


Let 


r  exp[-a2  x2  +  (3x1  dx  =  ^  exp 


4a2 


= 


p  = 


Iin|^(k-1 )  gp  +  2  Vk  g^(k-1 


a>0 


J 


dvi 


k-1 


(32) 


(33) 


(34) 


(35) 


Using  Equation  (33)-(35) 

(21),  we  find  that  Equation  (32)  becomes 


and 


substituting 


Equation 


where  05  is  the  normalizing  constant.  Proof  of  Equation  (36)  is  given  in  Appendix  1 . 
Note  by  induction  if  the  initial  probability  |i(vk)  is  Gaussian  it  will  remain  Gaussian  with 
a  mean  and  variance  propagated  by  the  following  equations 


m^(k)  = 


'  [H  a(k|k-1)  (z(k)  -Hb(k|k-1)) 

[Op+  o^(k-1) 

J +2m^(k-1)S(k)  J 

h2  a2(k|k-1)  ( 

2  2  A 

Op.  o^(k-1)j 

+  S(k)  ^ 

J 

(37) 


a^(k)  = 


S(k) 

"2  2  A 

ap+o^,(k-1)) 

( 

h2  a2(k|k-1) 

V 

/  2  2  ^ 

'jp+  yk-1) 

)  +  S(k)^ 

A 


respectively.  Note  that  m|j^(k)  is  the  estimate  of  the  process  input 

2.8  Overall  error  state  and  error  covariance  estimates 

The  combined  state  estimate  is  obtained  by  the  following 


(38) 


x(k,vk-l|k)=  /x(k,vk-i|k)  m(vk)  dvk 


(39) 


=  /  (a(k|k)  vk  +  b(k|k))  m  (vk)  dvk 


(40) 


=  a(k|k)  m,^(k)+  b(k|k)) 


(41) 


The  combined  covariance  is  obtained  by  a  Gaussian  Mixture  of  a  continuum  of 
probability  density  function,  i.e.  from  [1 ,  page  48]  we  find 


P(k|  k)  =  /  P(k|k)  m(vk)  dvk  +  /x(k,Vk|k)  m(vk)  dvk  -  x2(k|  k)  (42) 


=  P(k|k)  +  f  (a(k|k)  vk  +b(k|k))  2  m(vk)  dvk  -  x2(k|  k)  (43) 


=  P(k|k)  +  J  a2(k|k)  m(vk)  dvk  +  2  a(k|k)  b(k|k)  mj^(k)  +  (k|k)  -  x2(k|  k)  (44) 


P(k|k)  +  f  a2(k|k)  (v^-  m^(k))2  m(Vk)  dv^  +  a2(k|k))  J  (2  m^(k)  -  m^(k))  m(Vk)  dv^  + 

-CO  _00 

2  a(k|k)  b(k|k)  m^(k)  +  {k|k)  -  x2{k|  k)  (45) 


0  0 

=  P(k|k)  +  a2(k|k)  o,,(k)  +  a2(k|k))m,,(k)  +  2  a(k|k)  b(k|k)  mL,(k)  +  (k|k)  -  x2(k|  k) 


(46) 


3  Simulation  Results 


In  this  section,  we  present  an  empirical  analysis  of  the  continuum  model 
Kalman  filter  illustrating  its  superior  qualities  over  a  conventional  IMM  algorithm. 


Here  the  truth  data  is  the  same  for  both  algorithms.  Everything  such  as  noise 
covariance,  sample  time,  and  constant  position  with  velocity  bias  are  set  the  same  for 
both  algorithms  to  provide  a  fair  comparison.  The  IMM  was  implemented  with  three 
model  with  differing  biases,  namely  [-10  0  10]. 


Consider  the  results  shown  in  Figures  1-2..  It  is  clear  that  the  continuum 
model  Kalman  filter  outperforms  the  IMM  by  a  factor  of  1.6:. 25.  This  fact  is 
demonstrated  further  in  Table  1  showing  the  RMS  error  for  both  algorithms. 

4  Concluding  Remarks 

In  this  paper,  we  investigated  a  recursive  multiple  model  tracking  approach 
similar  to  the  Generalized  Pseudo-Bayesian  1  (GPB1)  [1]  approach.  Here  we  consider 
a  continuum  of  models  rather  than  the  discrete  set  that  is  usually  implemented  in  the 
GPB1  method.  By  doing  so  we  have  provided  better  models  to  improve  tracker 
performance  and  solved  the  bias  problem  inherent  in  most  multiple  model  approaches. 


Empirical  results  have  shown  conclusively  that  the  continuum  model  Kalman 
filter  is  capable  of  out  performing  the  IMM,  especially  while  operation  the  IMM  between 
fixed  models  velocities. 


By  defining  a  continuum  of  models  we  avoid  problems  frequently  associated 
with  multiple  model  techniques  that  use  a  finite  number  of  models. 


Appendix  1  -  Proof  of  Equation  36 


Using  Equation  (34)-(36),  we  find  that  Equation  (33)  becomes 


l^(Vk)  Vk)  exd  —2 


/k  rn^(k-l) 


=  ^  A(k,vk)  exp| 


20p  2ap(k-1) 


exp 

- 

_ 

-V 

2mp(k-1 )  Op  +  2vk  g^(k-1 )  ^  ^ 


2a^a'p(k-1) 


l_2a^  2a^(k-1) 


exp 


2  2^2 

mp(k-1)  gp  +  vk  j 

>(°P+  “pc''') 


(47) 

(48) 


=  — A(k,Vk)  exp| 


=  ^  A(k,vk)  exp| 


- 1 

< 

ro 

m^{k-1) 

''k  +  ^  ®p  +  m^{k-1)  Op 

■  2 

_ 

2a^(k-1) 

exp 

2a^a^p(k-1)(a^+  a^(k-1)) 

(49) 


2  2  r  2  2, 


2apa^(k-1)^ap+  ap(k-1) 


(50) 


=  ^  A(k,vk)  exp| 


2  2 
Vk-2m^(k-1)vk  +  m^(k-1) 

(2  2 

2  [.p4  yk-D 


(51) 


where  C2  is  the  normalizing  constant.  Substituting  Equation  (21)  into  (51)  yields 


1 


l^(vk)  =  ^  exp| 


"  [Ha(k|k-1  )Vk  -  (z(k)  -Hb(k|k-1  ))]2" 

”2  2  “ 
Vk-2m,^(k-1)  vk  +  m^(k-1) 

[■  2S(k)  J 

exp 

2(op+o^(k-1)] 

(52) 


C3 


exp 


h2  a2(k|k-1  )\-2H  a(k|k-1 )  (z(k)  -Hb(k|k-1 ))  +  (z(k)  -Hb(k|k-1  ))2 

r  2  2  1 

\'2m^(k-1)Vk+m^(k-1) 

L‘  2S(k)  J 

exp 

2  2„ 

2  (ap+  o^(k-1)) 

(53) 


exp 


I 

^h2  a2(k|k-1)  (  Op  +  a^{k-1)^  +  S(k)  'j 

l\-2| 

(^H  a{k|k-1)  (z(k)  -Hb(k|k-1))  (  0p  +  ap(k-1))  +  2  m^{k-1)  S(k)  ^ 

Kk 

2S(k)  (  ap+  c^{k-1)) 

C4 


(54) 


C4 


exp 


H  a(k|k-1 )  (z(k)  -Hb(k|k-1 ))  I  +  o^(k-1 )  )  +  2  m^(k-1 )  S(k) 


P 


im: 


H2a2(k|k-1)(op+  Op(k-1))  +S(k) 


Vk 


S(k)lap+  a^(k-1) 


H2a2(k|k-1)(op+  Op(k-1))  +S(k) 


(55) 


Completing  the  square  we  obtain  Equation  (36).  Proof  is  complete. 
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Figure  1-  The  ensemble  statistical  results,  over  100  Monte  Carlo  runs,  for  a 
conventional  IMM  with  three  diffusion  models  (or  velocity  biases),  namely  [-10  0  10]. 
Note  that  there  is  an  obvious  bias  in  the  result. 


Figure  2-  The  ensemble  statistical  results  for  100  Monte  Carlo  runs  of  the 
continuum  model  filter.  There  is  no  bias  in  the  result. 

Table  1 :  RMS  error  value  for  both  algorithms  the  continuum  model  algorithm  and 

the  IMM 


Algorithm 

RMS 

Continuum  Model 

Kalman  Filter 

.25 

Interacting  Multiple  Model 
Filter  (IMM) 

1.66 

